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Abstract 

We introduce partial actions of trace monoids (free partially commutative 
monoids) over finite sets as a model of asynchronous dynamical system. We 
characterise Markov measures for these systems by finitely many parameters 
with suitable normalisation conditions. 

The uniform Markov measure attached to an action is constructed. It is 
characterised by a real number to , the characteristic root of the action, and 
a function of pairs of states, the Parry cocyle. A new combinatorial inversion 
formula allows to identify a polynomial of which to is the smallest positive root. 

Examples based on simple combinatorial tilings are studied. We introduce 
the tip-top action, a natural action of a trace monoid on its set of independence 
cliques. It identifies for certain monoids with the action of flips on the domino 
tilings of a thin strip. 

AMS Subject Classification: 37B10, 68Q87 

1—Introduction 

The emerging of network systems over the past decades has revealed the need for 
taking into account a particular feature of certain dynamical systems, namely their 
asynchronous behaviour. Concurrency theory from Computer Science has studied var¬ 
ious models involving asynchrony. But few has been done for giving a mathematical 
ground to a notion of dynamical system involving an intrinsic notion of asynchronous 
actions. This paper is an attempt to establish such a ground. 

The notion of asynchronous systems has applications outside the field of Computer 
Science. Network systems, in a broad sense, can be seen everywhere. In a chemical 
solution with several products and several enabled reactions for instance, different 
chemical reactions can occur concurrently: there are potential applications in natural 
and physical sciences as well. 

A convenient starting point for expressing the asynchrony, or parallelism, of two 
“actions”, say a and b —whatever their exact nature is—, is the commutativity re¬ 
lation ab = ba. It renders the essential feature that the order of execution of these 
two actions is irrelevant. These considerations naturally lead—as noticed by several 
authors [12, 11]—to considering a presented monoid Ai of the form: 

Ai = {T, \ ab = ba), 

for (a, b) ranging over a fixed symmetric and irreflexive relation on the set E of 
generators. 

In the literature, such monoids are called free partially commutative monoids, 
heaps monoids or trace monoids [9, 30, 11, 29, 18]. They have a nice interpretation in 
Combinatorics through Viennot’s heaps of pieces theory. Because of their applications 
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in both fields, trace monoids stand at an intersection point between Computer Science 
and Combinatorics. 

In most relevant applications, the notion of state of a system is essential. A 
natural structure for an asynchronous system is thus a pair where A is a 

finite set of states, and AI is a trace monoid, together with a right monoid action 
ip : X X M ^ X oi M over X, denoted by (p{a,x) = a - x. If 1 denotes the unit 
element of the monoid, the monoid action obeys the two following axioms: 

a • 1 = q; , a ■ {x ■ y) = {a ■ x) ■ y . 


It is worth observing that acceptor graphs are a particular instance of the above. 
Indeed, let A be a finite set, and let M be an incidence matrix over A. Hence 
M = satisfies G {0,1}, and the system can go from state i to 

state j in one step if and only if Mij = 1. Let: 

^ = Kb j) G ^ ^ ^ ~ 1 } I 


thought of as the set of admissible elementary actions, and let S* be the free monoid 
generated by the admissible actions. 

Consider a symbol _L ^ A, and put A' = A U {_L}. Then the dynamics of the 
system corresponds to the unique right action A' x E* —>■ A' such that: 


VzGA' V(j,A:)gE i-{j,k) 


_L, if i ^ j or if i = _L 
k, if i = j 


The acceptor graph defines thus a “partial action” of the free monoid S* over 
the set of states A. The action is “partial” in the sense that not all actions are 
always enabled, depending on the current state of the system. But, up to adding a 
distinguished state T, partial actions are actually a particular instance of a standard 
action A' x S* —>■ A', with the additional feature that the trajectories to be considered 
are those that avoid to ever hit the distinguished state T. Hence these correspond to 
partial actions without asynchrony; and at a theoretical level, partial actions can be 
treated as normal actions of a free monoid over a set of states. 

The generalisation of “partial actions” to asynchronous systems will be central in 
this work. Formally, an asynchronous system consists of a pair (A, AI), where A is a 
finite set of states, AI is a trace monoid, together with a right action A x AI —>■ A . 
The set A is equipped with a distinguished state _L; “trajectories” to consider will be 
those that avoid to ever hit the distinguished state T. 

Dynamics is introduced by means of probability. We define a Markov measure over 
an asynchronous system (A, AI), as a family P = (Pcj^gx of probability measures 
indexed by the set of states, and obeying the following chain rule, without giving the 
full definition of all terms for now: 


Va G A Vx,yGM Fa{x ■ y) = Fa{x)Fa.x{y) 

If A is a singleton, or if Pq, is independent of a, then the property becomes P(x • 
y) = P(x)P(j/), which corresponds to Bernoulli measures—or memoryless measures. 
Bernoulli measures on trace monoids have been the topic of a previous work co¬ 
authored with J. Mairesse [4]. The present work covers the generalisation to the 
Markovian case. 

We characterise all Markov measures associated with an asynchronous system 
(A, Al) through a finite family of probabilistic parameters with certain normalisation 
conditions. These normalisation conditions are polynomial in the parameters; they 
are expressed by means of a fundamental combinatorial device, the Mobius transform, 
particularised for the framework of trace monoids. 
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Markov measures are our main object of study in this paper. Specially interesting 
is the case where the asynchronous action is only partially defined. We then require 
that = 0 whenever x is an action not enabled at state a. Their existence 

is not obvious. For accepto graphs—hence, without the asynchrony feature—, the 
Parry construction [22, 16, 20] demonstrates the existence of a “uniform” measure, 
Markovian, and charging with positive probability every admissible finite trajectory if 
the accepto graph is irreducible. The generalisation of this measure to asynchronous 
systems is the second contribution of this paper. 

We show that the uniform measure of an asynchronous system is a Markov measure 
V = {va)a^x in our sense. It has the following form, for x enabled at state a: 

Va{x) = tjf 'r(Q;, a ■ x) jxj = length of x 

Here, to is a real number lying in (0,1) and is called the characteristic root of the 
action; and r(-,-):XxX— J-Risa positive function, called the Parry cocyle, with 
the following property: r(a,/3)r(/3, 7 ) = r(a, 7 ). This holds under an irreducibility 
assumption on the action. 

Determining to and the Parry cocycle is challenging when facing concrete exam¬ 
ples. We introduce a simple combinatorial example of asynchronous action, related 
to tiling models. We illustrate our theoretical results by solving the problem of de¬ 
termining both the characteristic root and the Parry cocycle in several different ways 
for this example. 

The growth series ^ trace monoid M \s a. well studied object. It 

is given by the inverse of the Mobius polynomial of the monoid (also called the 
independence polynomial in a graph theoretic context [19]). This directly relates the 
radius of convergence of the series with the root of smallest modulus of the Mobius 
polynomial. One method for obtaining this inversion formula is based on the theory 
of formal series over partially commutative variables [9]. In our context, where not 
only the monoid but also its action over a set is involved, we have discovered that a 
slight generalisation of this theory allows to obtain similar results. It is thus another 
contribution of this paper to introduce formal fibred series over non commutative 
variables, and to show their application for determining the radius of convergence of 
growth series of the form: 

z^{t) = Y. 

xGAI : 

X enabled at a 

The characteristic root to corresponds to the common radius of convergence of the 
above power series, for a ranging over the set of states. We obtain a generalisation 
of the Mobius polynomial of a trace monoid, of which to is the smallest root. This 
amounts to encoding not only the combinatorics of the monoid, but also of the action, 
into a certain polynomial with integer coefficients. 

Organisation — In order to keep the paper self-contained, we have gathered in 
Section 2 some background on trace monoids. We have also included a summary on 
Bernoulli measures for trace monoids; although we shall not use the related results 
directly, their comparison with subsequent results on Markov measures will probably 
be useful to the reader. 

Section 3 introduces the notions of total and partial actions of trace monoids. We 
also introduce the example of the tip-top action of a trace monoid over its set of 
cliques. We particularise it for the trace monoid generated by the flips of the domino 
tilings of a strip, producing the Rabati tiling example. 

Section 4 is devoted to a general study of Markov measures for actions of trace 
monoids. We introduce the notion of fibred valuations and of Mobius fibred val¬ 
uations. We show that Markov measures correspond to Mobius fibred valuations. 
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Markov measures are given a realisation through the Markov chain of states-and- 
cliques. 

In Section 5, we particularise our study to the case of partial actions. The goal 
is to show the existence of a Markov measure with same support as the action. To 
this aim, we construct the uniform measure related to the action, and we show that 
it is Markovian. In the course of this construction, we introduce the characteristic 
root of the action and its Parry cocycle. We give an inversion formula which allows 
to interpret the characteristic root of the action as a particular root of a polynomial 
attached to the action. 


2—Preliminaries 

In this section we collect the needed facts concerning trace monoids and the construc¬ 
tion of associated Bernoulli measures. Each time a new notation is introduced, it is 
understood that we shall later refer to the designated object through this notation. 

Bibliographical references are gathered in § 2.5. 

2.1 — Trace monoids 

2.1.1 Independence relation — An alphabet E is a finite non empty set, and we 
will always consider that |E| > 2. Elements of E are called letters or pieces. An 
independence relation / is a binary irreflexive and symmetric relation on E. 

2.1.2 Trace monoid — Let be the smallest congruence on the free monoid E* 
containing all pairs (a5, ba) for (a, h) ranging over I. The trace monoid AI = AI(E, I) 
is the quotient monoid M = E*/.^/ . 

2.1.3 Traces — Elements of AI are called traces. Letters of E are identified with 
their images in through the canonical morphisms E —>■ E* —>■ AI. Concatenation 
in A1 is denoted with the dot . The unit element is denoted “1” and is called the 
empty trace. 

2.1.4 Immediate equivalence — Let TZi be the binary relation on E* containing all 
pairs of words of the form {xaby, xbay), for x,y € Tt* and (a, b) G I. Then jUj is the 
reflexive and transitive closure of TZi. 

2.1.5 Length of traces — Since two 7^/-related words have the same length, and 
since is the transitive and reflexive closure of TZi , all representative words of a 
given trace have the same length. This defines thus a mapping | • | : A1 —>■ N, and |a;| 
is called the length of trace x. The length is additive: \x ■ y\ = |a;| + \y\. The empty 
trace is the unique trace of length 0, and letters are the only traces of length 1. 

2.1.6 Divisibility relation — The left divisibility relation in A4 is denoted 

X < y 3z € A4 y = X ■ z. As in any monoid, it is reflexive and transitive. 

From the additivity of length, it is also easily seen to be anti-symmetric, hence (Al, <) 
is a partially ordered set. 

2.1.7 Compatible traces — Two traces x,y G Ai have a least upper bound xV y 
with respect to < if and only if there exists a trace z G M such that x < z and y < z. 
In this case, x and y are said to be compatible. 

2.1.8 Cliques — A clique of Al is a trace of the form x = ai ■ ... ■ Oi, where a* 

are pairwise distinct letters such that i ^ j (ai,aj) G I. Consider the pair 

(E, J) as a graph. Then cliques are in bijection with those subgraphs of (E, I) which 
are complete graphs—these are indeed called cliques in a graph theoretic context. 
Restricted to cliques, the ordering relation < corresponds to the inclusion of subsets, 
when seeing cliques as subsets of E. We denote by the set of cliques, and by 
€ = 'rf\{l} the set of non empty cliques. 

2.1.9 Parallelism of cliques — Two cliques c,c'G‘rf are said to be parallel, denoted 
c II c', whenever c- c' G‘^. When seeing cliques as subsets of E, this is equivalent to: 
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Figure 1: Two congruent words and the resulting heap (trace) for M — (a,b, c \ a- c = c-a) . 
Pieces a and c fall in a parallel way, but not a and b and neither c and b. 


c X c' Q I. In particular, and since single letters are cliques by themselves, we have 
a II a' {a, a') € I if a, a' € S. 

2.1.10 Cartier-Foata relation — Two cliques c, c' G are Cartier-Foata compatible, 
denoted by c —>■ c', if for every letter b G c' there exists a letter a G c such that 
ia,b)il" 

2.1.11 Cartier-Foata normal form. Ffeight of traces — For every non empty trace 
a; G \ {1}, there exists a unique integer n > 1 and a unique sequence (ci,..., c„) 
of non empty cliques such that: (1) Ci -G c^+i holds for all i G {1,... ,n — 1}; and 
(2) a; = Cl • ... • c„ . The sequence (ci,..., c„) is called Cartier-Foata decomposition 
(or normal form) of x. 

The integer n is called the height of x, denoted by n = t(x). By convention, we 
put r(l) = 0. 

2.1.12 Heaps of pieces — Heaps of pieces provide a visually intuitive representation 
of traces. Picture each letter as a piece, or domino, falling from top to bottom until 
it reaches the ground or a previously placed piece. Two pieces a, 5 G S are bound 
to fall in a parallel way with respect to each other if and only if (a, b) G I, which 
renders the commutativity relation a ■ b = b ■ a. Then it is part of Viennot’s theory 
that heaps of pieces thus obtained are in bijection with traces. We illustrate the heap 
representation in Figure 1. 

2.1.13 Layers of heaps and Cartier-Foata normal form — In the heap of pieces 
representation of traces, the cliques that appear in the Cartier-Foata decomposition 
correspond to the successive horizontal layers, from bottom to top, that compose 
the heap. For the trace depicted in Figure 1, the Cartier-Foata decomposition is 
a —>■ 5 —>■ a • c. 

2.2 — Growth series and Mobius inversion formulas 

2.2.1 Crowth series and Mobius polynomial — The growth series of the monoid M. 
is the power series H{t) defined by: 

m = E • 

The Mobius polynomial pM (t) of M is defined by: 

PM{t) = . 

For instance, for A4 = {a,b,c \ a ■ c = c-a), illustrated in Figure 1, one has = 
{1, a, b,c,a- c} and thus pM (t) = 1 — 3t -\-1^ . 
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2.2.2 First Mobius inversion formula — As a formal series, the growth series H(t) 
is rational, inverse of the Mobius polynomial; 


H{t) 


1 


( 1 ) 


2.2.3 Smallest root of the Mobius polynomial — The Mobius polynomial has a 
unique root of smallest modulus, which is real and lies in (0,1). This root coincides 
with the unique dominant singularity of (t). 

2.2.4 Mobius transform — Let / : R be a function (it could actually take 

its values in any commutative monoid). The Mobius transform of / is the function 
h : R defined by: 


Vce-r hic)= Y. (2) 

c'G*^ : c'>c 


2.2.5 Graded Mobius transform — If / : At —>■ R is defined on M, and not only 
on we extend its Mobius transform as follows. It is defined as in (2) on For 
t{x) > 2, let a; = Cl Cn be the Cartier-Foata decomposition of x, and let 

y = Cl ■ ■ Cn-i . Then we dehne: 


h(x) = Y (-1)''"' '"""'/(y c). 

cG'if : c>Cn 


The function h : AI ^ R is called the graded Mobius transform of /. 

2.2.6 Second Mobius inversion formula — Dehne AI(1) = '^ and, for each non 
empty trace x € M, put M{x) = {y G M : T{y) = t{x) /\ x < y} . Then, for any 
function / : AI —>■ R, with graded Mobius transform h : A4 —>■ R, holds: 

vxgm f{x) = Y ■ ( 3 ) 

y&M{x) 

Conversely, if /, ft. : AI —>■ R are two functions such that (3) holds, then ft is the 
graded Mobius transform of /. 


2.3 — Boundary and compactification 

2.3.1 Generalised traces — There exists a canonical partial order (AI,<), which 
elements are called generalised traces, and with the following properties: 

1. Every non decreasing sequence in M. has a least upper bound. 

2. There is a canonical embedding of partial orders l : M M, hence we identify 
A1 as a subset of M. 

3. Every element of Ai is the least upper bound \J{xn ■ n > 1} of a non 
decreasing sequence (xn)n>i with Xn € A4 for all n > 1. 

2.3.2 Infinite traces — Let dM = M.\M. Elements of dM are called inhnite 
traces, and dAi is the boundary at inhnity, or simply the boundary of Ai. For every 
^ G dAi, there exists a unique inhnite sequence (ci)i>i of non empty cliques such 
that holds: 


i=\/ {<^1’ Vi > 1 Ci^ Q+i . 

i>l 

The sequence (ci)i>i extends to inhnite traces the Cartier-Foata decomposition of 
traces (§ 2.1.11). 
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t{x) 


Figure 2: Illustrating the ordering relation x < ^ between a trace x, symbolised by the 

dotted line ., and an infinite trace symbolised by the solid line —. The height t{x) of 

X is depicted. 


2.3.3 Ordering on generalised traces — For each integer n > 0, the n-topping is the 
mapping Kn '■ A4 —> A4 defined by k„( 5) = ci • ... • c„ , where (ci)i>i is the extended 
Cartier-Foata decomposition of maybe with Ci = 1 whenever ^ G M and i > t(^). 

The ordering on traces is defined by the left divisibility relation (§ 2.1.6). Its 
extension on Ai can be characterised as follows: for all G AI, ^ holds if and 
only if KniO < for all integers n > 0. For x £ Ai and ^ G dAi, the relation 

X < ^ reduces to this: 

X<^ X < Krix)iO ■ 

The visual intuition of this result is illustrated on Figure 2. 

2.3.4 Elementary cylinders — For x £ A4, the elementary cylinder of base x is the 
subset of dAi denoted by t and defined by: 

■tx = {^£dAi : X < ^} . 

The existence of least upper bounds for compatible traces (§ 2.1.7) implies that 
elementary cylinders intersect as follows: 

0, if X and y are not compatible, 

t (x V y), if X and y are compatible. 

2.3.5 Topology on dAi and on Ai. Compactness — For each x G AI, let the full 
elementary cylinder fl" x be defined by: 

1)' X = {^ G Al : X < ^} . (4) 

The topology we consider on Al corresponds to the Lawson topology in Domain 
theory (see [13]). It is the join of the topologies S and £, i.e., the smallest topology 
containing both S and £. The topologies S (Scott topology) and £ (lower topology) 
are the topologies generated by the following subsets: 

S : fi X, for X G Al 
£ : Al \ (fl x), for X G Al 

The boundary dAi is equipped with the restriction of this topology. For our 
concern, we will only need the following facts regarding these topologies: 

1. For each trace x £ Ai, the singleton {x} is both open and closed in Ai. 

2. For each trace x £ Ai, f x is both open and closed in dAi, and fl x is both 
open and closed in Ai. 

3. The space Al is metrisable and compact; the subset dAi is closed in Ai. 
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2.4 — Bernoulli and uniform measures on the boundary 

2.4.1 a-algebras and ir-systems on A4 and on dAi — We equip Ai and dAi with 
their respective Borel cr-algebras, ^ and The cr-algebra on Ai is generated by the 
collection of full elementary cylinders fi x, for x ranging over Ai, defined in § 2.3.5. 

By the intersection property of cylinders (§ 2.3.4, see also § 2.1.7), we observe that 
both collections: 

{0}U{ta; : x ^ Ai} , {0}U{fia; : x & Ai} , 

are 7r-systems (i.e.: stable under finite intersections) generating ^ and S', respectively. 

2.4.2 Valuations — A valuation on AI is a function / : AI —>■ M such that /(I) = 1 
and f{x ■ y) = f{x)f{y) for all x,y G Ai. Valuations are in bijection with families 
or real numbers (Aa)aei: ■ The correspondence assigns to each valuation / the col¬ 
lection (/(a))aeE ■ The valuation is uniform if it is constant on S. It corresponds 
to: 

Wx G Ai f{x)=p^^^, Va G S p = f{a). 

2.4.3 Bernoulli measures — A Bernoulli measure is a probability measure on 
((9A1, S) such that: 

Vx, y G Ai P( t (x • y)) = P( t x)P( f y) ■ 

If P is a Bernoulli measure, the function / : x G AI i—>■ P( t a^) is the valuation 
associated with P. 

2.4.4 Mobius valuations — Let / : AI —>■ M be a valuation, and let ft- : AI —>■ M be 
the Mobius transform of / (§ 2.2.4). By definition, / is a Mobius valuation if: 

ft(l) = 0, Vc G £ ft(c)>0. 

2.4.5 Characterisation of Bernoulli measures — If P is a Bernoulli measure, then 
its associated valuation is Mobius. Conversely, let / : AI —>■ M be a Mobius valuation. 
Then there exists a unique Bernoulli measure P such that P(t x) = /(x) for all 
X G A4. 

2.4.6 Random decomposition of infinite traces — For each integer i > 1, let Ci : 
dAi —>■ £ be the mapping which assigns to an infinite trace f the clique in its 
extended Cartier-Foata decomposition. Let also: 

V = Cl • ... • Ci, 

be defined for all non negative integers, with Vg = 1 for f = 0. Then (Ci)i>i and 
(Vi)i>o are two sequences of measurable mappings. 

2.4.7 Markov chain of cliques — Under a Bernoulli measure P, the sequence (Ci)i>i 

is a Markov chain. The law of Ci is given by the restriction ft|^ , where ft : M is 

the Mobius transform of the associated valuation. In case the valuation /(•) = P( f •) 
is positive on A4, then the transition matrix P = {Pc,c'){c,c')&£x(t of fh® Markov chain 
(Ci)i>i is given by: 

Pc.c'= , 5(c) = 

2.4.8 Uniform measure — There exists a unique Bernoulli measure n such that the 
associated valuation is uniform. It is given by: 

Vx G A4 i^(tx)=pg^', 

where po is the unique root of smallest modulus of the Mobius polynomial pM 
(§ 2.2.1). 



2.4.9 Complement on elementary cylinders — It is useful to relate elementary cylin¬ 
ders (§ 2.3.4) and Fi-measurable subsets of dAi, where Yi has been defined in § 2.4.6. 
Let X be a non empty trace of height n = t(x). Then the elementary cylinder f x 
decomposes as the following disjoint union: 

U = (5) 

zeM(x) 

where M(x) = {z € M : t{z) = t{x) A x < z} has been introduced in § 2.2.6. 

2.5 — Bibliographical references 

The basics of trace monoids are covered, under different points of view, in [9, 30, 11, 
12]. A famous application of trace monoids to the combinatorics of directed animals 
is found in [8]. 

The first Mobius inversion formula is established in [9] and in [30]. The properties 
of the Mobius polynomial of a trace monoid are studied in [14, 18, 10]. The second 
inversion formula for graded Mobius transform is established in [1]. The simple Mobius 
transform is a particular instance of the notion of Mobius transform [24, 28]. 

The space of generalised traces is introduced in [4]. It is a particular instance of 
the completion of certain presented monoids studied in [2], and is also a particular 
instance of the completion of partial orders [15]. The topological properties are rather 
standard; they can, for instance, be established within the framework of [3]. 

Bernoulli and uniform measures for trace monoids are introduced in [4], in which 
only irreducible trace monoids were considered. Relaxing this assumption does not 
present major difficulties, as shown in [5]. 

3—Actions of trace monoids 


3.1 — Total actions 

A right action of a monoid M with unit 1 over a set X is defined by a mapping 
cp : X X M ^ X, usually denoted by (p{a,x) = a ■ x, and satisfying the following 
properties: (1) Va € X a ■ 1 = a; (2) \/a G X Vx ,y € A4 (a ■ x) ■ y = a ■ (x ■ y). 

In order to emphasise the distinction with partial actions to be defined later, we 
introduce total actions as follows. 

• Definition 3.1 —A total action is a triple {X,A4,ip), where X is a finite and non 

empty set, Ai is a trace monoid, and ip : X x Ai ^ X defines an action of Ai 

over X. We usually denote the action by (p{a,x) = a - x. In this context, elements 
of X are called states, elements of S are called elementary actions, and elements of 
Ai are called actions. 

Assume given a total action of a trace monoid Ai = A4(S, I) over X. Let a G X, 
and let a, a' G S with a ]] a' (see § 2.1.9). Then a ■ a' = a' ■ a and therefore: 
(a-a)-a' = (a- a') ■ a. The following proposition states a converse to this observation. 

• Proposition 3.2 —Let Ai = Ai(S, I) be a trace monoid, let X be a finite set, and let 
{‘Pa)a(^T, be a family of mappings (pa ■ X ^ X indexed by E. Assume that holds: 

Vo, a' G E a\\ a' tpa o ipa> = (fw o ■ 

Then there exists a unique total action ip : X x Ai ^ X such that ip{-,a) = (pa for 

all a G E. 

Proof. Immediate by the universal property of quotient monoids. □ 
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3.2 — Partial actions 


3.2.1 Definition — For several applications, it is desirable that some actions may 
not be always “enabled”, depending on the current state. It is this very feature that 
we aim at in introducing the following definition. 

• Definition 3.3— A partial action of a trace monoid A4 = Jl{(S,I) over a finite set 
X is defined by: 

1. A collection of subsets (S(a))Q,gx with S(q;) C S and S(a) ^ 0, where S(a) 
corresponds to the set of enabled elementary actions at state a. 

2. A collection {'f’a)aex of mappings, with ifa '■ S(q;) —>■ X denoted ifaici) = a ■ a 
whenever a € S(q;), such that for any a,b€T,, if a € S(q;) and if a || b, then: 

(i) Either b € S(a); and in this case a € S(a ■ b) and b € YApx ■ a) and 
{a ■ a) ■ b = (a ■ b) ■ a; 

(ii) Or b ^ Fl(a); and in this case b ^ I](q; • a). 

The intuition explaining the two properties of point 2 in the above definition is 
that an action 6 G S which is not enabled at some state a G X suffers from some sort 
of lock on it. The idea is that a parallel action a \\ b cannot unlock b; and neither can 
it lock b ii b was enabled. See a concrete example in § 3.3.3 below. 

3.2.2 Total action associated to a partial action — We now introduce a construction 
which associates a canonical total action to each partial action. Assume given a partial 
action with the same notations as in Definition 3.3. Let T be an element not in X, 
and let X' = A U {T}. For each a G X, extend ifa ■ E,{a) ^ X to a mapping 
t/iq : E —>• A by putting ipaia) = T if a ^ E(a), and put V’-l(') = -L- 

• Proposition 3.4 —There exists a unique total action of Ai over X' such that a ■ a = 
ipaici) for all a G X' and for all a G E. 

Proof. For each a G E, let (/?a : A' —>• A' be defined by (/?a(cr) = ifcia). We verify 
that (v3o)aeE satisfies the condition of Proposition 3.2. For this, let a, & G E with 
a II b, and let a G A'. Clearly, for a = ±, one has (pa o = ± = (pi,o (pa(-L). And 

for a G A, we discuss different cases. 

Assume that neither a G E(a) nor b G E(a) hold. Then: (paiTbicn)) = Ta(-L) = T 
and (pb((pa(a)) = ‘Pb(-L) = ±, hence ipa o Pbio:) = (/?& o (paia). 

Assume that both a G E(a) and b G S(a) hold. Then, by point (2i) of Defini¬ 
tion 3.3, the equality (pa o (pb(o:) = ipb° ¥’a(cr) holds. 

Assume that, of a and b, only one is enabled at state a, say a G E(q;) and 
b ^ E(q;). Then on the one hand: (pa(p’bic()) = TaiE) = T. And on the other hand, 
b ^ E(q! • a) by point (2ii) of Definition 3.3, and thus: ipbiPaio.)) = T, whence the 
equality cpa o p>bio:) = (pbO Taia). 

The result follows then from Proposition 3.2. □ 

3.2.3 Terminology — We speak of a “partial action A x A1 —>■ A” when considering 
the total action of Ai over A resulting from the construction of § 3.2.2 with respect 
to a partial action of Ai over A \ {T}, keeping the notation T for the distinguished 
state. 

3.2.4 Trace language associated with a partial action — We introduce below a 
collection of trace languages (a trace language is a subset of a trace monoid) associated 
with a partial action. 
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• Definition 3.5 —Let X x Ai ^ X be a partial action. For each state a € X, we 
define the subset Ma C A4 and the function Fa : Ai ^ {0,1} by: 

Ada — {a: G Ad . ex ‘ X _L} , Fa{F) — -f{a-a:^_L} • 

The family F = {Fa)aex is called the support valuation of the partial action. 

• Proposition 3.6— For each state a € X of a partial action XxAd —>■ Ad, the language 
Ada is downward closed: 

yx,y G Ad xGAda/\y<x yGAda. 

The support valuation satisfies the following properties: 

VaGX\{±} F„(l) = l 
\/aGX \/x,yGAd Fa{x ■ y) = Fa{x)Fa.x{y) ■ 

Proof. By contraposition, assume that x,y G Ad are such that y ^ Ada and y < x, 
we have to prove that x ^ Ada ■ Let z G Ai he such that x = y ■ z. Then, by the 
action property, one has: a-x = {a-y)-z = A- z and an easy induction shows that 
_L • z = _L for all z G Af. Hence a - x = A and thus x ^ Ada. The two properties of 
Fa follow. □ 

3.3 — Examples 

We introduce examples of actions of trace monoids, some of which will serve as running 
examples in the remaining of the paper. 

3.3.1 A natural total action — The heap of pieces interpretation of traces (§ 2.1.12) 
provides an example of a total action, which we informally describe. 

Any heap of pieces, and thus any trace, can be seen as a labelled partial order [30, 
17], the labels ranging over the alphabet S. As such, it has a number of maximal 
pieces; let M{x) be the labelled set of maximal pieces of a heap x. Let X be the finite 
collection of all possible labelled sets M{x), for x ranging over Ad. Then Ad acts on 
X hy M ■ X = M{y ■ x), where y is the flat heap that identifies with M. 

Hence M ■ x represents the set of pieces that can be seen, from above, when piling 
up the heap x over M. In case Ad is the free monoid S*, then X identifies with E 
and a • a; is the last letter of the word ax. Hence this action generalises in a natural 
way the Markov chain model, where states and actions coincide. 

3.3.2 Petri nets — Petri nets, also called place/transition systems and which come 
in several variants, are a well known model of concurrent systems, introduced in the 
1960’s and with as various applications as workflow control, formal verification of 
logical properties of systems, diagnosis and monitoring of discrete events systems, 
and performance evaluation and queuing network theory on the applied mathematics 
side [21, 6]. 

Without entering into the details of the model, let us mention that the executions 
of a Petri net are given as sequences of transitions. Each transition operates on 
the marking of the net, which corresponds to the global state of the system. For 
so-called bounded Petri nets, the set of reachable markings is finite. There is a 
structural independence relation between transitions [12], which naturally defines a 
trace monoid generated by the transitions. The action of transitions defines a partial 
action of this trace monoid on the set of markings of the Petri net. The so-called 
Petri net language consists then in the trace languages Ada od Definition 3.5. 

Note that the stochastic models usually attached to Petri nets, as in [6] for in¬ 
stance, randomize the execution sequences of the net, not their equivalence classes 
modulo commutativity of independent transitions, and differ thus radically from our 
model. 
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3.3.3 The tip-top action — Let be a trace monoid and let X = the set of 
cliques of M (§ 2.1.8). We define the tip-top action as the partial action (p ^ 

with: 


V 7 G ^( 7 ) = {a G S : a < 7 V a || 7 } 

V 7 G'^ VaGi;( 7 ) 7 )( 7 ,a) = ^ 7 ^ 

1 ^ 7 -a, if a II 7 

Let us verify that the tip-top action satisfies the condition of Definition 3.3. Let 
7 G and let a, 6 G E be such that a G E( 7 ) and a || b. We discuss different cases, 
observing that in all cases, 6 ^ a since a || b. 

1. Assume that a < 7 . Hence a) = 7 \ {a}. 

a) If & G E( 7 ). 

i. If & < 7 , then (p{^, b) = 7 \{&}. Since a b, we also have a < 7 \{&} and 

thus a G E( 7 j( 7 , b)) and (p{(p{'y, b), a) = 7 \{a, b}. For the same reason, 
^ < 7 \ {a} and thus b G a)) and a), b) = j \ {a, b} = 

T{Th,b),a). 

ii. If b II 7 , then 1 ^( 7 , b) = 7 - 6 . Hence a < pij, b) and thus a G S((/?( 7 , b)) 

and (p{(p{'-f,b),a) = 7 • 6 \ {a}. We also have & || 7 \ {a} thus b G 
S((/ 9 ( 7 , a)) and a), 6 ) = (7 \ {«}) ■ b = b),a). 

b) If 6 ^ ^( 7 )- Then b is not parallel to 7 \ {a} otherwise, since 5 || a, 6 would 
be parallel to 7 , contradicting b ^ E( 7 ). And 5 < 7 \ {a} does not hold 
either, otherwise 6 < 7 would hold, contradicting b ^ E( 7 ). We conclude 
that b ^ S( 7 )( 7 , a)), as expected. 

2. Assume that a || 7 . Hence a) = j ■ a. 

a) If 6 G E( 7 ). 

i. If 5 < 7 , then p{'i,b) = 7 \ {b}. Therefore a || (^( 7 , 6 ) thus a G 
E((/ 9 ( 7 , 6 )) and p{p{'-f,b),a) = (7 \ { 6 }) • a. On the other hand, 
b < (/?( 7 , a), thus b G S(p(j,a)) and p{p{'-f,a),b) = (7 • a) \ { 6 } = 
p{p{j,b),a). 

ii. If b II 7 , then p{'^,b) = 7 - 6 , but a || 6 hence a || p('y,b), thus a G 

S((/ 9 ( 7 , 6 )) and p{p{'y,b),a) = j ■ b ■ a. On the other hand, we also 
have b || 1 ^( 7 , a) since a || b, thus b G and p{p{'y,a),b) = 

7-a-6 = (/?((/?(7,6),a). 

b) If 6 ^ ^( 7 )- Then b < a) would imply 6 < 7 since a ^ b, contradicting 
b ^ E( 7 ). And b || p{''^,a) would imply b || 7 , contradicting b ^ E( 7 ). 
Hence b ^ Y,{p{j, a)), as expected. 

3.3.4 Domino tilings — Tilings of plane surfaces by 2 x 1 and 1x2 dominoes 
are an “extensively studied and well-understood latice model in statistical physics 
and combinatorics” [23, § 1.1]. Here, we point out that domino tilings and their flips 
provide a vast source of examples of partial actions of trace monoids; we will focus 
on elementary examples only, using them for illustrative purposes. 

Given a plane surface for which there exists at least one domino tiling, the flips 
rotate two contiguous dominoes and leave unchanged the rest of the tiling [25], as 
illustrated in Figure 3. 
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flip 


Figure 3: Illustrating the action of a Hip. The dot represents the centre of the rotation. 


3.3.5 The Rabati tilings — We define the n-Rabati strip, with n > 2 an integer, as 
a strip of size n x 2, as depicted on Figure 4 for n = 7. The in-line version is the one 
depicted on the figure; the circled version corresponds to the same strip, where the 
right most side is identified with the left most side. 

Consider the in-line version of the Rabati strip first. Then associate the trace 
monoid with n — 1 generators, say S = {ai,..., a„_i}, and independence relation I 
defined by: 

I = {{a^,aj) : \i - j\ > 2}. 

For the circle version of the Rabati strip, we consider the trace monoid with n 
generators, S = {uq, ... ,a„_i}, and independence relation: 

I = {{a^,aj) : {\i - j\ mod n) > 2 } 

In both cases, the following facts are elementary (see Figure 4): 

1. The domino tilings of the Rabati strip are in bijection with the cliques of the 
associated trace monoid. The empty clique corresponds to the tiling where all 
dominoes are in vertical position. 

2. Let 76 “^ correspond to some tiling of the strip. The flip centred on the 
f**' position is enabled if and only if the tip-top action (^( 7 , ai) is enabled; and 
the result ip{'^,ai) of the tip-top action corresponds to the tiling resulting from 
the action of this flip on the tiling 7 . 

Hence, for tilings of Rabati strips, the action of flips corresponds exactly to the 
tip-top action of the associated trace monoid. 

For tilings of general plane surfaces, we can still define a trace monoid associated 
to the action of flips, where each flip corresponds to a generator of the monoid, and 
commutativity of generators corresponds to flips that operate on disjoint pairs of 
dominoes. The combinatorial action of flips is encoded in the action of this trace 
monoid on the set of tilings. But this action does not correspond in general to the 
tip-top action of the trace monoid—it is, in general, much more complex. 

3.4 — Sub-actions and irreducibility 

We borrow some usual terminology and notions from sub-shift theory [27, 20] to 
qualify states and define irreducibility classes. Throughout this subsection, we fix a 
partial action X x Ai ^ X of the trace monoid Ai = Ai{Yj, I) over the set X. 



,ai , 

,02 , 

as , 


as , 

as 


HlL 


as 


04 


Or 


Figure 4: The in-line n-Rabati strip with n = 7. The tiling on the left corresponds to the 
empty clique. The tiling on the right correspond to the clique ai ■ ag . 
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3.4.1 Communicating states and essential states — A state a ^ _L leads to a state (3, 
which we denote by a => /3, if there exists a non empty trace x G Aia \ {1} such that 
a ■ X = P (and thus (3 ^ 1). Two states a and /3 communicate if both a ^ (3 and 
(3 ^ a hold, which we denote hj a (3. A state a is essential if a _L and holds: 
\/f3 G X a ^ (3 implies f3. 

Note that, by the action property, the relation a /? is transitive on A \ {-L}. 
Also, since S(a) 0 according to Definition 3.3, every state leads to at least one 
state. 

• Proposition 3.7 —There exists at least one essential state. 

Proof. Seeking a contradiction, assume there is no essential state. Pick ai G A\{_L} , 
which is a non empty set by definition. Then, by induction, construct an infinite 
sequence of states (Q;i)i>i such that: 

Vi > 1 ai ^ ai+i A -'(ai+i ai). 

Then, by transitivity of the communicating relation, holds: 

Vi < j ai ^ aj A ~'{aj ai). 

Since A is a finite set, there are two integers i < j such that ai = aj . But then 
ai ai and -'(on ai) both hold, a contradiction. □ 

3.4.2 Sub-actions and irreducible sub-actions — A non empty subset Y C X \ {T} 
defines a sub-action ii a ■ a G Y for all a G A and for all a G S(q;). Equivalently, 
a-x GY for all Of G A and for all x G Xia ■ In this case, the restriction of A x AI —>■ A 
to (AU{T})xAl —>■ AU{T} defines a partial action. Clearly, sub-actions correspond 
to non empty subsets of A \ {T} closed under the communicating relation between 
states. 

We define a sub-action A to be irreducible if it has no other sub-action than itself, 
and an action to be irreducible if it is irreducible as a sub-action of itself. Clearly, 
every state of an irreducible sub-action is essential in the sub-action and in the original 
action. 

• Proposition 3.8 —The set of essential states of the action defines a sub-action. For 
each essential state a, the set 


A„ = {/3gA : a^/3} 

defines an irreducible sub-action. Every irreducible sub-action is of this form. 

Proof. The transitivity property of the communicating relation implies that any es¬ 
sential state leads to an essential state. Hence the set of essential states, which is non 
empty by Proposition 3.7, is closed under the communicating relation between states 
and defines thus a sub-action. 

Let a G A be an essential state. Then Aq, is the strongly connected component 
containing a of the communicating relation. It is thus irreducible. Conversely, if A 
is an irreducible sub-action, pick a G A. Then A^ C A by definition of A being a 
sub-action, and thus Aq, = A by definition of A being irreducible. □ 

3.4.3 Example — The tip-top action i^:‘^xAI—^■‘^ofa trace monoid over 
its set of cliques (§ 3.3.3) is irreducible, and thus every clique is an essential state. 
Indeed, if 7 y^ 1, then ip('^,^) = 1; and for 7 = 1 , pick any letter a G S, then 
(/?((/?(!, a), a) = (p(a,a) = I. Henceforth every clique leads to the empty clique. And 
similarly it is easy to see that the empty clique leads to every clique. We deduce 
7 77 7 ' for all cliques 7 , 7 ', and thus the action is irreducible. 
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4—Markov measures 


We now come to our main object of study, Markov measures associated with actions 
of trace monoids. In this section, we examine Markov measures associated with total 
actions. Next section is devoted to additional topics of study when the total action 
actually originates from a partial action. 


4.1 — Markov measures and fibred valuations 


4.1.1 Definitions — We recall that the boundary i9A4 of a trace monoid A1 (§ 2.3.2) 
is equipped with its Borel a-algebra (§ 2.4.1). 

• Definition 4.1 —Let X x M ^ X be a total action of a trace monoid A4 over a 
finite set X. A Markov measure associated with this action is a family P = (Pa)aex , 
where each Pq is a probability measure on the boundary dXi, satisfying the following 
chain rule: 


\/a&X yx,yeM Pa(t (a; • 2/)) = Pa(t a;)Pa.a:(12/) • (6) 

A fibred valuation associated with this action if a family F = {fa)aex , where each 
/a : A4 —>■ M is a real-valued mapping, with the following property: 


Va G X /„(1) = 1 (7) 

Va G X \/x,yGM faix ■ y) = fa{x)fa.xiy) (8) 

// P = (PQ)agx is a Markov measure, the family F = {fa)aex defined by: 

Va G X Vx € A4 /q (x) = Pq ( t a;) (9) 


is called the fibred valuation associated with P . The support valuation of P is the 
family S = {sa)aex of mappings Sa ■ A4 {0,1} defined by: 


'ia € X Vx G A4 Sq(x) 


1, ifPQ(tx)>0, 

0, ifPQ(tx) = 0. 


( 10 ) 


4.1.2 Elementary remarks — Bernoulli measures on dXi (§ 2.4.3) correspond to 
Markov measures P = (Pa)aex such that Pq is independent of a. In particular, 
Markov measures exist. 

If A1 = S* is the free monoid with its natural right action on E, then Markov mea¬ 
sures correspond to Markov chains on E. Bernoulli measures correspond to Bernoulli 
sequences with values in E. 

Clearly, the support valuation of a Markov measure is a fibred valuation. 

Since the family of elementary cylinders forms a 7 r-system (§ 2.4.1) of the Borel 
CT-algebra on dM, a Markov measure P = (Pq)^^^ is entirely characterised by the 
countable family of non negative numbers {PQ(t x) : a G X, x G A4}. In turn, by 
the chain rule ( 6 ), these are entirely determined by the finite family of non negative 
numbers {/^(a) : a G X, a GT,}. Hence, characterising Markov measures consists in 
finding adequate normalisation conditions on finite families of non negative numbers 
of the form (Aa(a))(a,a)eXxs ■ 

4.1.3 Fibred valuations — A first task consists in elucidating the—rather simple— 
structure of fibred valuations. 


• Proposition 4.2 —Fibred valuations are in bijection with families {XaiO'))(ci,a)&xxi: of 
reals numbers satisfying the following series of equations, that we call the concurrency 
equations: 

Va G X Vo, 6 gE a II & Xa(a)Xa.aib) = Xaib)Xa-bia) (11) 

The bijection associates to a fibred valuation (fa)aex the family of reals {faia,))(a,a)&xxi: ■ 
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Proof. If (fa) Qgx is a fibred valuation, then the family of reals defined by AQ(a) = 
fa{ci) satisfies the concurrency equations, since both the left and the right members 
of the equation in (11) represent fa{a ■ b), when a \\ b. 

Conversely, let {Xaia))(a,a)£XxT: be a family of reals satisfying the concurrency 
equations. We show the existence of a fibred valuation F = {fa)a£X satisfying 
/a(o) = ^a{a) for all a € X and a GH. 

Define for each a G X and each word x = ai... On of E*: 

/*a(^) — Aq,(g.i) Afj-ai (^ 2 ) ‘ ■ ■ AQ,.ai.,,,.an —1 (^n) 7 (i^^) 

with /a(l) = 1 by convention. Then the concurrency equations imply that faix) = 
fa{y) for any word y which is in immediate equivalence with x (§ 2.1.4). Therefore 
fa factorises through a mapping, still denoted /„ : A4 —>■ R such that /a(a) = )^a{a) 
for all a G E. The definition (12) implies the validity of the chain rule (8), whence 
the sought fibred valuation F — i^fa'lct^x • □ 

• Corollary 4.3 —If (Pa)aex is a Markov measure, then the numbers AQ(a) = PQ(t a), 
for a ranging over X and a ranging over E, satisfy the concurrency equations (11). 

4.2 — Characterisation of Markov measures 

Our aim is to give necessary and sufficient conditions for a family {Xa{a))(a,a)&xxT: 
of real numbers to correspond to the family (/a(a))(a,o)eXxs obtained from the 
fibred valuation of a Markov measure. Theorem 4.5 below gives necessary conditions, 
postponing their sufficiency to next subsection. 

4.2.1 Mobius fibred valuations — The following definition generalises to fibred val¬ 
uations the notion of Mobius valuation recalled in § 2.4.4. 

• Definition 4.4 —Let F = {fa)aex be a fibred valuation. For each a G X, let ha ■ 

R. 6e the Mobius transform (§ 2.2.4) o//q : R. The fibred valuation F is 

Mobius if it satisfies the following conditions, for all a G X: 

ha(l) = 0, (13) 

Vq G C haij) > 0. (14) 

Remark that, as a consequence of the second Mobius inversion formula (§ 2.2.6), 
a Mobius valuation is necessarily non negative. 

4.2.2 Identification theorem — The purpose of the following theorem is twofold. 
First, it provides necessary conditions on families of numbers that generate a Markov 
measure. Second, it shows that the random process of “states-and-cliques” (defined in 
the statement) has the structure of a Markov chain, of which the initial measure and 
the transition matrix are entirely determined by the Markov measure. In both aspects, 
it generalises the corresponding results for Bernoulli measures (§ 2.4.5 and § 2.4.7). 

• Theorem 4.5 —Let P = (PQ)Qgx be a Markov measure on a total action XxM —>■ X. 
Then: 

1. The fibred valuation associated with P is Mobius. 

2. Let and (Ti)i>o be the two random sequences introduced in § 2.4.6, and 

for each integer i > 0, let Xi = a ■ Yi . Then, under the probability Pq-j, , the 
sequence {Xi-i,Ci)i>i is a homogeneous Markov chain with values in X x €. 

3. The initial measure of the Markov chain (^i-i, C'i)i>i is (f{ao} ® (^ao lij) > where 
hao\^^: £ —>■ R denotes the restriction of hag to non empty cliques, and hag : 

R is the Mobius transform of the fibred valuation associated with P. 
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( 15 ) 


4- The transition matrix of the chain is independent of ao . It is given by: 

V (7') 


,'y') a-7} 1{7—>-7'} 


9a'il) 


where 7 —>■ 7 ^ denotes the Cartier-Foata relation between cliques (§ 2.1.10), and 
Pa' : £ —>■ M 15 the non negative function defined by: 


9a'{l)= ^ he,'{-/'). 

: 7 —>- 7 ' 


(16) 


If ga'{ 1 ) = 0 , then the expression (15) is replaced by: 


-^(a,7),(a^,7') 0- 

4.2.3 Remark on the transition matrix — The matrix P described above might 
have some lines entirely filled with zeros. This happens for the lines indexed by pairs 
(a, 7 ) where 7 is such that 30 . 7 ( 7 ) = 0 . 

Although formally forbidden for stochastic matrices, this is actually of little in¬ 
convenience since these lines correspond to states that will never be reached. 

4.2.4 Strategy of proof — We first establish the two following key lemmas. All the 
statements of Theorem 4.5 derive from them. 

The proof follows closely the same line as the proof of the corresponding results 
for Bernoulli measures (§ 2.4.5 and §2.4.7), with the specific issue here consisting in 
correctly dealing with the random current state. 

• Lemma 4.6 — Let (Pa)aex be a Markov measure associated with a total action X x 
Af —>■ A, and with fibred valuation {fa)aex ■ For each a € X , let ha : A4 ^ be the 
graded Mobius transform (§ 2.2.5) o//q(-). Let n > 1 be an integer, and let x € A4 
be a trace of height t(x) = n. Then: 

"Fa{yn=x)=ha{x). (17) 

Proof. Let x and n be as in the statement. The formula (5) decomposes the elemen¬ 
tary cylinder f as a disjoint union, whence: 

Pa(ta;)= ^ Fa(Y„=z). 

zeMix) 

We also have Pq (t a;) = /«(a;) by definition of fa ■ Hence, by the reciprocal of the 
second Mobius inversion formula (§ 2.2.6), we deduce that the two functions fa and 
X G M 1 -^ PQ-(17(a;) = x) are related by the graded Mobius formula, whence (17). □ 

• Lemma 4.7— Let F = {fa)aex be a fibred valuation. For each a G X, let ha : ^ ^ 
R be the Mobius transform of fa , and Zef 3 q, : £ —>■ R. be defined as in (16). Assume 
that ha{T) = 0 for all a G X (in particular, this holds if F is Mobius). 

Then, for all j3 G X and for all 7 G £, holds: 

fp{l)ga{l) = hp{j), fora = / 3 - 7 . (18) 

Proof. Let (3 G X and 7 G £, and put a = /3 • 7 . We compute as follows: 


5a ( 7 ) 


7'GC : 7^7' 


E ( E (-X"' 

7'GC : 7^7' : 7">7' 



X (“1)'’^ '/a(7")^(7.7") 

7"6«’ 
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with 


7'6C 

For 7 , 7 " G a clique 7 ' G £ satisfies 7 —>■ 7 ' and 7 ' < 7 " if and only if 7 " < 5, 
where 5 = {a G 7 " : 7 —>■ a}. Therefore, adding and subtracting the empty clique in 
the sum defining 5 ( 7 , 7 ") using the binomial formula, we find: 

B{l, i)= ^ (-l)l'y I - 1 = - 1 = . 


We obtain thus the following expression for 30 ,( 7 ): 

9o.{l) = - E (-l)''^"'/a(7")- (19) 

7"G'^ : -'(7"ll7) 


Writing down the hypothesis ho(l) = 0 yields, by the very definition of the Mobius 
transform ha- 


E (-l)'""'/o(7")=0. 

7"G‘^ 


Separating this sum according to those cliques 7 " which are on the one hand, and 
which are not on the other hand, parallel to 7 , and by virtue of (19), we obtain: 

ffo(7)= E (-l)''^"'/o(7")- (20) 

7"G‘^ : 7"||7 

Since a = /3 • 7 on the one hand, and by the chain rule for fibred valuations on 
the other hand, we have: 


//3(7- 7 ") = //3(7)/a(7") • 

Therefore, multiplying both sides of (20) by // 3 ( 7 ) yields: 

//3(7)5a(7)= '//3(7-7") 

7"ll7 

= E (-i)'"”''^'//3(<5) 

: (5>7 

= ^/3(7), 

which was to be proved. □ 

4.2.5 Proof of Theorem 4.5 — Let us show that the hbred valuation F = {fa)a£X 
associated with the Markov measure P is Mobius. According to Lemma 4.6, and since 
Cl = Yi, we have: 


VyGC: P„(Ci = 7 ) = ha(7) • 

It follows at once that ho, ( 7 ) > 0 for all 7 G £, which proves the property (14). 
And applying the total probability law to the first clique Ci yields: 

E^“(7) = 1 - 

7GC 
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But we also have, by the Mobius inversion formula (3): 

/a(l) = /ia(l) + 

lec 

1 = /la(l) + 1 , 

whence /iq( 1) = 0, which proves the property (13). Henceforth we have proved that 
F is Mobius and that the law of (Xq, Ci) under is indeed given by i5{a} 0 {ha\^) ■ 
This proves points 1 and 3 of the theorem. 

Let P be the square matrix indiced by {X x and defined by (15), with the 
restriction that P(a,'y),(a',Y) = 0 whenever gain) = 0 - We shall prove that, for any 
sequence (xq, ci),, (a;„_i, c„) in X x £ with n > 1 , if denotes the probability 

Pn — ^a { (^0 7 ) — (^0 7 Cl), . . . , iXji— 1 , Cji) — (^n— 1 7 Cn)) 

and if denotes the result of the chain rule: 

9" “ l{a=a7o}^xo(ci)T’(a7o,ci),(a7i,C2) • • •-P(a7„_2,c„_i),(a7„_i,c„) 

then Pn = qn . This will prove the statements 2 and 4 and complete the proof 
Theorem 4.5. 

First, it is clear that Pn = 9 n = 0 if any of the following statements does not hold: 

xo = a, ( 21 ) 

Vz £ {07 ... 7 n 2 } Xi * — Xj-i-i, (^^) 

Vz € {1,... ,n - 1} n^Ci+i. (23) 

Hence, assuming that all the above statements (21)-(23) hold, we have: 

Pn — ^a(Xn = Cl * ... * Cn) 

= ha{ci ■ ... ■ Cn) by Lemma 4.6 

Defining yj = ci •... • cj for all j G {0,..., n} , the definition of the graded Mobius 
transform (§ 2.2.5) together with the chain rule relation for fibred valuations yield: 

Pn — faiyn—l)hxn-\ipn) (^4) 

The above implies in particular the following inequality, valid for any integer 
j < n: 


Pn ^ ^a{Xj — Cl '...' Cj) 

^ fa(yj-l)hxj_i{Cj) 

Therefore, if gxj-i (c^-i) = 0 for some integer j G {2,..., n}, then on the one hand, 
hxj-iin) = 0 for all 7 G £ such that Cj-i —>■ 7 holds, and in particular hxj_i{cj) = 0, 
and thus p„ = 0. But = 0 also on the other hand, and thus Pn = Qn ■ 

It remains thus to examine the most interesting case, where all statements (21)- 
(23) hold and gxj-i (cj) 0 for all j G {2,..., n}. In this case, we apply the result of 
Lemma 4.7 and we divide by gxj-i{cj) to obtain, since Xj = Xj-i ■ Cj: 


Vj G {l,...,n-1} fxj.Acj) = 


hxj-ijcj) 

9xi{cj) 


(25) 
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We evaluate qn- 


Qn — ^xq (ci ) 


^xi(c2) hxy^_i{Cn) 


* ' * yxn-i(Cn-l) 

hxQ (ci) h 

Xl (C2) h,„.ACn-l) 


hxn—li^n) 


9xi{ci) gx 2 {^ 2 ) 5a:„_i(Cn—l) 

“ /a:o(^l)/a:i(^2) ■ ■ • fxn-2 (Cn) 

— fa{^l * . ■ • * Cn—i^hx^_i{C'fi^ 

= Pn 


by (25) 

by the chain rule 
by (24) 


This completes the proof of Theorem 4.5. 


□ 


4.3 — Realisation of Markov measures 

4.3.1 A reciprocal to Theorem 4.5 — A striking result of Theorem 4.5 is that the 
fibred valuation associated with a Markov measure is necessarily Mobius. The next 
result shows that the converse is true. Furthermore, it provides a realisation of the 
associated Markov measure by means of the Markov chain of states-and-cliques. 

The effectiveness of the Mobius conditions for fibred valuations, and thus for the 
parameters of Markov measures, is discussed below in § 4.3.2. 

• Theorem 4.8 — Let F = {fa)aex be a Mobius fibred valuation. Then there exists a 
unique Markov measure P = (Pa)aex such that fa(x) = Pa(t x) for all a G X and 
all X G Ml. 

Let P be the transition matrix on X x € defined in (15). For each a G X, let 
(Aj_i,C'i)i>i be a Markov chain with transition matrix P and with initial measure 
i5{a} 0 {ha\^), defined on the canonical probability space (11, ©,Qa). Then Pq, is the 
law of the random variable ^ : 11 —>■ dMl defined by: 

e = V (^1 • • • • • ^-), 

n>l 


under the probability Qa . 

Proof. We first need to check that the Markov chain in the statement is well defined, 
that is to say, that (5 {q} 0 {ha\^) is a probability distribution on A x €, and that P is 
a stochastic matrix. The second point is obvious by construction. For the first point, 
indeed ha\^ is a probability distribution on € since, on the one hand, ha > 0 by 
definition of F being Mobius, and on the other hand, by the second Mobius inversion 
formula (§ 2.2.6): 

hail) = haij) since ha{l) = 0 

76 C 7G‘g’ 

= /.(!) = 1- 

For each a S A, let Pq be the probability measure on dM defined as in the 
statement as the law of Vn>i(^i ’ • • • ’ C'n), under Qq . Let a; G A1 be a trace. The 
decomposition from § 2.4.9 of the elementary cylinder f x yields: 

PQ(ta:)= y] Qa{Ci ■ ... ■ Cx^x) = z). (26) 

zeM(x) 
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Let n = t{x), and z & M he a, trace of height t{z) = n. Then z has a Cartier- 
Foata decomposition of the form ci c„ . We set yj = ci -.. .■ Cj and Xj = a-yj 

for all integers j £ {0,..., n}, and: 

Qn — — Cl, , Cn — . 


Then we have: 


Qn — 


Qa(-^0 — CH, Cl — Cl, • ■ • , Xfi—l — 
, / , hxi (02) ha:n_i (Cn) 

hxo{ci) (c„_i) ^ 

/ \ • / \ ^x„^i[Cn) 

9xi{Cl) 9x„-i{Cn-l) 

fxo (ci) • . • fxn-2 (Cn—l)hx„_i (Cn) , 


I, c„ 


Cn) 


since a = xq 


the last equality by using Lemma 4.7, which applies since F is Mobius by assumption. 

By the chain rule for the fibred valuation F on the one hand, and according to 
the definition of the graded Mobius transform (§ 2.2.5) on the other hand, we obtain 
thus: Qn = ha{z). 

Returning to (26), applying the second Mobius inversion formula (§ 2.2.6) yields: 
Pa(ta;)= ^ haiz) = faix). 

zGMix) 

This completes the proof of the theorem. □ 


4.3.2 Effectiveness of Mobius conditions — Since Theorems 4.5 and 4.8 entirely 
characterise Markov measures by means of Mobius fibred valuations, it is natural to 
examine to which extent this condition is effective. 

A natural question is the following: given a family of real numbers A = (Xaia)) {a,a)ex xs : 
can we effectively determine the existence of a Markov measure P = (Pa)agx such 
that Pa(t a) = AQ,(a) for all (a, a) £ X x S? It amounts to knowing whether: 

1. The family A dehnes a fibred valuation. 

2. In this case, the fibred valuation has to be Mobius. 

The Hrst point is solved by Proposition 4.2: the family A must satisfy the concur¬ 
rency equations. These are a finite number of equalities to be satisfied. 

For the second point, we observe that the Mobius conditions stated in Dehni- 
tion 4.4 consist in a series of equalities and another series of inequalities. Assuming 
that the Hrst point is fulfilled, the equalities and the inequalities only involve poly¬ 
nomial expressions of the terms AQ,(a), for (a, a) ranging over X x E. 

Finally, the question is entirely answered by means of polynomial conditions in¬ 
volving only the terms of the family A. Giving a parametric form for all Mobius 
fibred valuations, and thus all Markov measures, is yet another question which is not 
treated here. 

Next subsection is devoted to the study of an example illustrating the use of the 
machinery described above. 


4.4 — Examples of Markov measures on a Rabat! tiling 

4.4.1 Setting — We consider the 4-Rabati strip in line (§ 3.3.5), of which we depict 
in Figure 5 the five possible domino tilings. Recall that the tilings correspond to the 
set of five cliques ‘W = {l,a,b,c,a- c} of the trace monoid 

A4 = {a, b,c \ ac = ca). 
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Figure 5: The Eve tilings of the 4-Rabati strip corresponding, from left to right, to the 
cliques 1, a, b on the top line and to the cliques c and a ■ c on the bottom line. 


The partial action generated by the enabled flips, which corresponds to the tip¬ 
top action of the trace monoid Ai (§ 3.3.3), is conveniently represented by a graph, 
depicted on Figure 6 -(a). Since each action is reversible, the graph is non oriented. 




(a) (b) 

Figure 6: (a)— Graph of the action of Hips on the 4-Rabati tilings. Vertices are labelled 
by states (cliques) and edges are labelled by elementary actions (letters). (6)— Graph of the 
probabilistic actions of Hips on the same Rabati tiling, with probabilistic parameters q and 

P = 1 - V?- 

4.4.2 Markov measures for the partial action — In order to fit with the previous 

setting, we have to consider the total action (‘^U{_L}) x A4 —>■ Crf x {T}), as described 
in § 3.2.2. Introducing the probabilistic dynamics however, we impose the additional 
constraint that -L) = 0 for all j G ‘rf, so that _L is never reached. In the 

following, it amounts to merely omitting _L. 

4.4.3 Markov measures with symmetries — Let us tackle the task of determin¬ 
ing all Mobius fibred valuations F = , if any, with the following symmetry 

properties: 


/i(a) = /i(c), fa.c{a) = fa.c(c ), (27) 

and such that f-y{x) > 0 whenever x is a letter enabled at 7 . 

4.4.4 Parameters — In a direct approach intending to illustrate the above notions, 
let us introduce the following parameters that entirely encode our problem: 


P = fi{a) = fi{c) q = fi{b) 

r = fa{c) r' = fa{a) 

t = fc{a) t! = /c(c) 

U = fa-M) = fa-cic) q' = fb{b) 
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We write down the concurrency equations (Proposition 4.2): 


At I: 

fi{a)fa{c) 

= /i(c)/c(a) 

i.e. pr = pt 

At a: 

/a(a)/i(c) 

= fa{c)fa.c{a) 

i.e. r'p = ru 

At b: 

none 


At c: 

/c(c)/i(a) 

= /c(a)/a.c(c) 

i.e. t'p = tu 

At a ■ c: 

/a.c(a)/c(c) 

= fa-c{c)fa{a) 

i.e. ut' = ur 


Since u,p > 0 we deduce at once: r = t and r' = t' and we are thus left with 


parameters p, q, q', r, r', u with the only equation: 

r'p = ru . (28) 

We write down the Mobius equations ^-,,(1) = 0 for 7 ranging over 

At 1: l — 2p—q + pr = 0 (29) 

At a : 1 — r' — r + r'p = 0 (30) 

At 5: l-q' = 0 (31) 

At c: same as (30) 

At a • c: 1 — 2m + ur' = 0 (32) 


4.4.5 Solutions — Equation (32) re-writes as: m(1 — r') = 1 — u . Replacing r'p by 
ru in (30), thanks to (28), and then multiplying by u yields thus: 

(1 — m)(1 — ru) = 0 . 

Assume that u 1. Then ru = 1, but since both r and u lie in (0,1] it implies 
r = M = 1, and similarly thanks to (28), r' = p = 1, but then g = 0 by (29), 
contradicting our assumption fj{x) > 0 for all enabled letters x. 

Therefore m = 1, and thus r' = 1 by (32), and p = r by (28). We now only have 
two parameters p and q related hy 1 — 2p — q + p^ = 0, yielding p = 1 — y/q. Here the 
additional inequalities from Mobius conditions are trivially satisfied for q G (0,1). 

We obtain thus a continuum of Markov measures satisfying the symmetry condi¬ 
tions (27). All the parameters of the graded valuation corresponding to the Markov 
measure are deduced from q, using the above relations. They are graphically gath¬ 
ered in Figure 6 -( 6 ). So for instance, starting from the tiling correspond to the empty 
clique, the probability of obtaining the trace ■ a is: 

Pi(t • a) = fi{a)fa{a)fi{c)fc{c)fi{b)fb{b)fi{a) 

= pr'pr'qq'p = p^q = {I - y/^fq. (33) 

It could have been computed alternatively, yielding the same result: 

\ ■<?■ b^ ■ a) = \ a ■ c ■ c ■ a ■ ■ a) 

= fiia)faic)fac{c)faia)fi{b)fb{b)fi{a) 

= prur'qq'p = p^q = (1 - ^/q)^q ■ (34) 

In order to construct Markov measures for this example, we have used a direct 
approach, writing down the concurrency equations and the Mobius equations, and 
solving them by hand. We shall see below in next section a more elegant way of 
constructing Markov measures. 
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5—Uniform measures 


In the previous section, we have characterised Markov measures for total actions by 
means of a finite number of probabilistic parameters. In § 4.4, we have seen examples 
of Markov measures (Pa)aex for a partial action X x Ai ^ X, with the following 
additional property: 

Va G X Wx G M Pa(t a;) > 0 x G Ma , (35) 

where Ma = {x G M : a ■ x ^ 1.} is the trace language associated with the partial 
action (§ 3.2.4). 

Property (35) is natural when dealing with a partial action: the probabilistic 
dynamics should only concern enabled actions. 

It is not obvious, in view of the results from the previous section, that Markov 
measures satisfying (35) necessarily exist for every partial action. It is the aim of this 
section to prove this result for irreducible actions. The measure we obtain generalises 
to trace monoids the uniform measure for irreducible sub-shifts of finite type, due to 
Parry [22, 20, 16]. 

5.1 — Growth series and characteristic root 

We put aside for a moment the probabilistic dynamics, and focus on the combinatorics 
of partial actions of trace monoids. In subsection 5.3, we will see how both aspects, 
probability and combinatorics, combine together and lead us to a notion of uniform 
measure. 

We consider a partial action X x M ^ X oi a trace monoid over a finite set X. 
5.1.1 Growth series — For each a G X \ {-L}, let Za{t) be the power series defined 
by: 


Za(t)= Y. fN, 

X^Aia. 

where Ma denotes the trace language associated with the action. Let ta be the radius 
of convergence of Za ■ Since Za has only non negative terms, ta is a singularity of Za ■ 
For each integer /c > 0, let Ma{k) denote the subset of traces Ma{k) = {x G 
Ma '■ \x\ = k} . Since at least one letter is enabled at each state, it is easy to see 
that ^Ma{k) > 1. And since Za{t) also writes as Za{t) = X]fc>o 
have Iq < 1. 

5.1.2 Characteristic root of an irreducible action — We show below that the real ta , 
which characterises the growth of the monoid acting on X and starting from a, does 
not depend on a if the action is irreducible. 

• Lemma 5.1 —If Oi leads to (3 (a^ j5 with the notation o/§ 3.4.1^, then talftp. 

Proof. Recall that we are only dealing with power series with non negative coefficients. 
Assuming that a ^ (3 holds, let x G Ma be such that f3 = a ■ x. Then we have 
X ■ y G Ma for every y G Mp , and therefore: 

Za{t)> Y 

veMfi 

It follows that Za{t) < oo Zisft) < oo , whence the inequality tp >ta. □ 

• Corollary 5.2 —If the partial action is irreducible, then ta is independent of a. 
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Proof. Any two states a and (3 of an irreducible partial action communicate: a ^ (3 
and j3 ^ a. Hence ta = tp by Lemma 5.1. □ 


The corollary justifies the following definition. 

• Definition 5.3 —For an irreducible partial action, the common value ta , for a rang¬ 
ing over X, is called the characteristic root of the action. We denote it by to . 

We shall now study an inversion formula, which extends to actions of trace monoids 
the first Mobius inversion formula valid for trace monoids (§ 2.2.2). It will justify the 
term of “root” for to . 

5.2 — An inversion formula for actions of trace monoids 

5.2.1 Formal fibred series over non commutative variables — We extend the notion 
of formal series over partially commutative variables [26, 9] in order to take into 
account not only the combinatorics of a trace monoid, but also the combinatorics of 
a trace monoid acting on a finite set. 

• Definition 5.4 —Given the partial action X x Ai ^ X, we consider for each pair 
(a,j3) of states, the trace language Aia.p of those traces leading from a to [3, hence 
defined by: 

Aia ,0 = {x G A4 : X G A4a /\ a ■ x = 13} . (36) 

A fibred formal series is a sguare matrix F = {Fa,p)(a,p)£Xxx > where each Fa^p 
is a mapping Fa,p '. M. , such that holds: 

Mx G M Fa,p{x) ^ 0 X G Ma,p ■ 

We see Fa,p as a formal sum indexed by Aia,p ■ We denote by 7 j{{A 4, X)) the set of 
fibred formal series. 

An element F G h{{A4,X)) is a formal fibred polynomial whenever Fa^p has a 
finite support, for any (a, j3) G X x X . 

5.2.2 Ij-algebra structure for h{{AA,X)) — If Fa^p and Ff j^ are two formal sums 
indexed by A4a,p , we define their sum Fa^p + Ff^^ term by term, leading to another 
formal sum indexed by A4a,p • The scalar multiplication XFa^p is defined by the 
scalar multiplication of each term. 

If Fa,p and Gp^-./ are two formal sums indexed by Aia,p and M.p,-y respectively, 
we can define their Cauchy product Fa^pGp^-^ as the a formal sum indexed by , 

each term being defined by the following finite sum: 

{F^^pGp,-,)(x)= Y. Fa,,piy)Gp,.yiz) (37) 

y.z=x 

Next, we define the product of two fibred formal series F and G by the matrix 
product: 

{FG)a,'y = Fa,pGp^-f , 

/3GX 

where each product in the sum is taken as in (37). 

Then clearly, Z((AI, A)) has the structure of a Z-algebra, of which fibred formal 
polynomials are a sub-algebra. The identity element is the identity matrix I = 
{Ia,p){a,p)(zxxx 1 which terms are defined by: 

V(cr, /3) G X X X Vx G AA.a,P — l{a—/5}I-{a:—l} • 
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5.2.3 Zeta series and inversion formula — We shall be interested by two elements 
of 1{{M,X)) in particular. 

• Definition 5.5 —The zeta fibred formal series is the element C. G X)) defined 

by: 


V(a, fi) e X X X Vx G Ma,l3 Ca,p{x) = 1. 

For each pair (a, /3) G X x X, let '^a,p denote the set of cliques leading from 
a to P, if any: '^a,p = H A4a,/3 ■ The Mobius fibred polynomial is the element p, 
defined by: 

y{a,P)GXxX Vx G Ma Ma,/3(a;) = ■ 

Then we have the following inversion formula. 

• Theorem 5.6 —The Mobius fibred polynomial is the formal inverse of the zeta fibred 
formal series: 




Proof. By definition of the product in Z{{M, X)), we have for {a, fi) G X x X and 
for X G Ma.p: 

(kw(^) = E( E (-1)'"') 

= E (-1)'"' ’ 

1/G‘^c : y<x 

where denotes fl Ma ■ The binomial formula yields thus: 


{K)a,p{x) 


1, if X = 1, 

0, otherwise. 


But X = 1 implies a = fi, and so we have proved = I. The equality C/x = I is 
proved similarly. □ 


5.2.4 A morphism toward a single formal variable — In order to exploit the above 
inversion formula (Theorem 5.6) for counting purposes, we follow a classical pattern 
by projecting fibred formal series onto series over a single formal variable. 

• Definition 5.7 —The algebra of single fibred formal series is the algebra Zjc[[<:]] of 
square matrices indiced by X, where each entry is a formal series over the single 
formal variable t. 

The algebra of single formal polynomials is the sub-algebra of Zjs:[[t]] such 

that each entry is a polynomial in t. 

It must be noted that if F and G are two formal series over t given under the 
form: 

F=J2 ^ = E ’ 

xdM xGA4 

then their product is given by the following Cauchy product formula with respect to 
the multiplication in the monoid Xi: 

^^=E( E FyG.y>. (38) 

xGAi (y,z)GA4xA4 : y-z—x 
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• Proposition 5.8 —The mapping $ : Z{{A4,X)) —>• defined as follows, for 

F G Z{{M,X)): 


V(a,/3) G X X X ^ 

x^Ai 


is a morphism of Z-algebra. 

Proof. The property $/ = / is obvious. The property $(FG) = $(F)$(G) is the 
matter of a simple verification left to the reader based on (38). □ 

5.2.5 The theta polynomial — We now introduce the Z series, which strong combi¬ 
natorial meaning justifies the introduction of the above material. 

• Definition 5.9 —The Z series is the single fibred formal series defined by: 
'i{a,l3)eXxX Z^,p{t)= 

The Mobius single polynomial p G Zx[t] is defined by: 

V(a,/3)GXxX ^iaAt)= 

76«’c,/3 

The theta polynomial is the standard polynomial 9{t) G Z[t] defined as the following 
determinant: 


9{f) = det pA) . 

For instance, if the partial action is that of a sub-shift of finite type generated 
by an incidence matrix M over the set of states, then the single Mobius polynomial 
is fi{t) = I — tM. See computations of fj,{t) and of 9{t) for actions with asynchrony 
in § 5.4.2. 

• Theorem 5.10 —The Mobius single polynomial is the formal inverse in Zjc [[t]] of the 
Z series: 


At)z{t) = z{f)At) = I, 

where I is the identity matrix defined by la, pit) = l{a=p} ■ 

Proof. This derives by applying the morphism <f> of Proposition 5.8 to the inversion 
formula stated in Theorem 5.6, since $(C) = Zit) and $(^) = ^(t). □ 

• Theorem 5.11— The characteristic root to of the action X x A4 ^ X is the smallest 
positive root of the theta polynomial. 

Proof. Let t G (0,to)- Then all terms in Z(t) are non negative convergent series, 
therefore the equality ^(t)Z(t) = I holds in the space of real matrices M„(]R), with 
n = |X|. Therefore 9(1) 0. 

Assume, seeking a contradiction, that 0(to) 0. Then p.(t) is invertible for all t 

in the closed interval [0,to]- Therefore the real matrices Zit) are uniformly bounded 
on [0,to)- 

Observe now that, for t < to and for a G X, the line indiced by a of the real 
matrix Zit) has its terms that sum up to the convergent growth series Zait). Hence 
we obtain that Zait) is bounded on [0, to)j a contradiction which completes the proof 
of the theorem. □ 
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5.2.6 Reduction to the standard Mobius inversion formula — Theorem 5.10 entails 
the first Mobius inversion formula (§ 2.2.2) as a particular case. Consider indeed the 
trivial action of a trace monoid Ai over a singleton {*}. Then Z{t) identifies with the 
growth series H{t) = J^xeM Mobius fibred polynomial is simply the Mobius 

polynomial /ix(t) = formula in Theorem 5.6 is the inversion 

formula (1). 

5.3 — Construction of the uniform measure 

5.3.1 Measures on Ai — We recall that Ai = AiUdAi denotes the set of generalised 
traces. It is equipped with a metrisable topology, for which it is a compact space 
(§ 2.3.5). 

Assume that the partial action X x Ad —>■ A" is irreducible. For a £ X and for 
t £ (0,to)) let denote the probability measure on Ai defined by: 

' xeMa xeMa 

• Lemma 5.12— For each state a £ X and for each trace x £ Aia , the full elementary 
cylinder •f)' x defined by: 


fi X = {f^£ Ai : a:<^} 


is given the h'a,t-pi'obability: 


y a;') - M 


Proof. Since na.t only charges A4, Va,t{i!\ x) is given by the following sum: 

1 


X) = 


Zc{t) 


E 


y^Aia '• 

The traces y G A4a such that x < y are of the form y = x ■ z with z £ Aia-x , hence: 


X) = 


1 


Zct(t) 






zeMa 


Zq.xjt) 

Zq(t) 


The proof is complete. □ 

• Lemma 5.13 —For an irreducible partial action, the probability measures {va,t)t<to 
have a weak limit when t ^ t^ . This limit, denoted by Vq , only charges dAi , and 
na(f x) >0 for every x £ Aiq . 

Proof. First, we fix a G X. Since A4 is compact, there exists a probability measure 
Wq on A4 which is a weak limit of a sequence {i^q,t„)n>o j for —>■ t))". 

For X £ Ai, the singleton {a;} is both open and closed in Ad. It has thus an empty 
topological boundary. Therefore, by the Portemanteau theorem [7], the following 
equality hods: 


nq{{x}) = lim J^a,t„({a;}) 


lim 

n—¥(X) 


t 


X 

71 


Za{tn) 


= 0 


since tn < t^ < 1 on the one hand, and since limt_>tg Zq{t) = oo on the other hand. 
The set Ad is countable, and thus Vq{Ai) = 0. 
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The elementary cylinder fl" a; is also both open and closed in j\4. Using again the 
Portemanteau theorem, we have thus: 

x) = lim (fr x). 

n—>-oo 


Since Va{M) = 0, it follows: 

/ \ 1* / A \ i\x\ T ^a-xiin') 

i^ait x) = hm V X) = 1 '^' hm - 7 ^— 7 —-, 

n—>00 n—KXD Z/Q,(tn) 

the last equality by virtue of Lemma 5.12. 

Focus now on the ratio Za.x{t)/Z^it). It is a ratio of power series with non 
negative coefficients. It has therefore a limit, for t ^ , which is either zero, or a 
positive real, or + 00 . We have just seen that, for some sequence —>■ , the ratios 
Za-x(tn)/Za{tn) have a non negative limit. We deduce: 


,. Za.x{t) 
0 ^ 


t — ¥t. 




G [0,oo) 


(39) 


It also follows that the probability measure i^a has its values on elementary cylin¬ 
ders t X entirely determined by these limits, independently of the sequence (t„)„ . 
Therefore the family {va,t)t<to has Va as weak limit when t ^ Iq . 

It remains only to show r'Q,( f x) > 0 for x G Ala . It amounts to showing that 
the limit in (39) is positive. Let /3 = a - x. Since the action is irreducible, there exists 
y G Ai 13 such that a = j5 ■ y. Applying (39) to (3 and y in place of a and x, we have: 


which also writes as: 


lim 


Zp{t) 


< 00 


lim 


Zq-xjt) 

Za{t) 


> 0 . 


(40) 


This completes the proof of the lemma. 


□ 


5.3.2 The Parry cocycle — The above lemma has the following consequence. 

• Corollary 5.14 — For each pair of states (a,/3) G X x X of an irreducible partial 
action, the following limit: 

r(a,/3) = lim (41) 

exists and lies in (0,oo). 

Proof. Since the action is irreducible, every j3 G X writes as j5 = a ■ x for some 
X G Ai a ■ The statement of the corollary was then shown in the course of the proof 
of Lemma 5.13, in (39) and in (40). □ 

• Definition 5.15 — For an irreducible partial action X x Ai X, the Parry cocyle is 

the function r(-,-) : X x X ^ (0, 00 ) defined by (41). 

The term “cocyle” is appropriate, since the definition (41) of r(-, •) makes obvious 
the two following properties: 


'iaGX 

V(a,/ 3 , 7 ) G A X A X A 


r(Q;, a) = 1 

r(a, 7 ) = r(a,/3)r(/3,7) 


(42) 

(43) 
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5.3.3 Uniform measure — We can now combine the results obtained so far to obtain 
the following theorem. 

• Theorem 5.16 —Let X x A4 ^ X be an irreducible partial action. Then there exists 
a Markov measure, denoted v = (vafat^x and called the uniform measure, satisfying 
the following property: 

'ia&X Vx G Ma i^ait x) = t^Q^T{x,a ■ x), (44) 

and x) =0 ifx ^ Aia ■ In particular, the support ofv coincides with the support 
of the partial action. 

Proof. According to Lemma 5.13, we shall define na , for each a G X, as the weak 
limit of Va,t for t —>■ tg , and then put n = {va)a^x ■ 

The relation (44) follows from an application of the Portemanteau theorem as in 
the proof of Lemma 5.13, starting from the result of Lemma 5.12 and taking the limit 
t —>■ tp . Since the Parry cocyle is positive, Vaif x) > 0 for all x G A4 q . 

If x A4a , then na.tih x) = 0 for all t < to by the very definition of Va,t and 
since Me is downward closed according to Proposition 3.6. Therefore, passing to the 
limit still legitimated by the Portemanteau theorem, we obtain i^Q,(t x) = 0. Hence 
^ = {vafa^x has same support as the action. 

It remains to show that v thus defined is Markovian. For this, we verify the 
validity of the defining relation: 

Va G X \/x,yGM ndf {x ■ y)) = i/dt x)na.x{t y) ■ (45) 

If X ^ Ma or if j/ ^ Ma-x , then both members of the above equality are zero. And 
for X G Ma and y G Ma-x , using the cocyle property (43), we have: 

i^a(t (x ■ y)) = ^'r(a,a • X • y) 

= t[j''r(Q;, a ■ x)t[f'r(Q; • x, (a • x) • y) 

= Va{f x)Va.x{f y) 


The proof is complete. □ 

5.4 — Example: uniform measure of a Rabat! tiling 

We illustrate the construction of the uniform measure on the simple example already 
encountered in § 4.4 of the 4-Rabati tiling in line. 

5.4.1 Continuing the direct approach — Let us tackle the problem of determining 
the uniform measure directly through its Mobius fibred valuation F = . 

For symmetry reasons, it is clear that F satisfies the conditions fi (a) = fi (c) and 
fa.c{a) = fa-cic), hence it fits within the framework previously studied in § 4.4. 

At the end of § 4.4.5, we were left with the only parameter q = fi{b), from which 
all other values characterising the Mobius valuation F can be deduced. Given the 
special form of the uniform measure, we have on the one hand: 

h{b) = tor{i,b) 
fb{b) = toT{b, 1) 

and on the other hand, by the cocyle property (43) and since fb{b) = 1: 

r(6,i) = to' r(i,6) = r(5,i)-i 
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Therefore: 


q = tor(i,&) = tl 

Applying the same reasoning for p = fi{a) we have, using that /a(a) = r' = 1: 

p = tor(l, a) 1 = tor(a, 1) = tor(l, a)“^ = — 

P 

Therefore p = = q . But we also found 1 — 2p — q + p"^ = 0, therefore: 

1 — 3p + = 0 


and we recognise that p = ^ ^ is the only root in (0,1) of the Mdbius polynomial 
of the monoid M = {a, b,c \ ac = ca). The characteristic root of the action is: 


^ /a-V5 

Since we have obtained the value of to and we can determine the Mobius fibred 
valuation, we can deduce the values of the Parry cocyle, through the formula (x) = 
'r( 7 , ip( 7 , x)). By the cocyle property, it is enough to give the values of r(l, •): 

r(l,a)=to r(l,6) = to r(l,c)=to r(l,a-c)=to 

We obtain thus the following formula for the cocycle: 

r(7,7') = t{7''-''^'. (46) 

We can check that we obtain the same value for Pi (f a;), with x = ■ iP ■ a, 

as we found in (33) and in (34): 

Pi(t a;) = tif'r(l,(p(l,x)) = , 

which corresponds to the value p^q found previously, since p = q = . 

5.4.2 Using the theta polynomial — We could also have obtained the value of to by 
applying the result of Theorem 5.11, which implies to determine the theta polynomial 
of the action. The Mobius single fibred polynomial (Definition 5.9 in § 5.2.5) is the 
following matrix indexed by : 


1 

/I 

-t 

-t 

-t u\ 

a 

—t 

1 

0 

U -t\ 

h 

—t 

0 

1 

0 

0 

c 

—t 

u 

0 

1 

—t 

a • c 


—t 

0 

-t 1) 


The theta polynomial is the determinant of the above matrix, found to be equal to: 

e{t) = {I - it^ + t^){l - t^f 

Via the result of Theorem 5.11, we recover that tp is the root in (0,1) of the 
Mobius polynomial 1 — 3p + of the monoid. 

We shall obtain yet another time this result by studying more generally tip-top 
actions, of which Rabati tiling actions are a particular case (§ 3.3.3-3.3.5). 
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5.5 — Example: uniform measure of the tip-top action 

In this subsection, we study the uniform measure associated with the tip-top action 
of a trace monoid over its set of cliques (§ 3.3.3). 

We recall from § 3.3.5 that the action of flips on a Rabati tiling is a particular 
case of a tip-top action. Hence our study will allow us to re-obtain results on the 
uniform measure of the 4-Rabati tiling in line, which we previously obtained by hand 
through Mobius equations and symmetry considerations in § 4.4 and § 5.4. 

Our hrst result, below, shows that the presence of I’s on all ascending arrows in 
the graph of Figure 6-(b) is due to a general fact. 

• Lemma 5.17 —Let P = be a Markov measure on the tip-top action At —> 

and let be the associated Mobius valuation. Then holds: 

VaGS a <7 /-^(a) G {0,1} . 

Proof. Let 7 G and let a G S be such that a < -f. Then by induction, it is easy to 
see that for any trace x G Al^ of the form x = ai ■... ■ Un with ai a for all integers 
t G {1,..., n}, then m || a holds, and a G Mj.x also holds. In words: as long as a has 
not been played, it cannot be disabled. 

Therefore, assuming that fj{a) > 0 holds, then the Markov chain of states-and- 
cliques has positive probability to hit a state-and-clique where the clique involves a, 
and the set of such states-and-cliques will remain accessible as long as no clique 
involving a has been produced. Hence this will eventually occur with probability I. 

Returning to the valuation point of view, it implies that the cylinder f a has 
P.y-probability I. Hence f-y{a) = 1, which was to be proved. □ 

• Corollary 5.18 —Let he the Mobius fibred valuation associated with the uni¬ 

form measure of the tip-top action. Then holds: 

1. V 7 G Va G S a < 7 / 7 (a) = 1 • 

AV 7 G<^ /7(7) = 1 - 

Proof. Let 7 G and let a G S be such that a < 7 . By Theorem 5.16, the uniform 
measure has same support as the support of the action. Therefore, since a G Al^ if 
a < 7 , one has /^(a) > 0 and thus / 7 (a) = I by Lemma 5.17, which proves point 1. 

For point 2, let 7 G Then 7 writes as 7 = oi •... • a*, where the Oi are pairwise 
parallel. By the chain rule for the fibred valuation on the one hand, and using the 
result just proved on the other hand, we have: 

flil) = / 7 (ai)/a 2 -...- 0^(02 • . . . • Oi) = fa2-...-ai{a2 • . . . • Oj). 

Hence, by induction, /^(y) = 1, which was to be proved. □ 

The structure of the uniform measure of the tip-top action is then entirely de¬ 
scribed by the following result. We re-obtain in particular the values for the charac¬ 
teristic root and for the Parry cocycle found in § 5.4.1 for the 4-Rabati tiling in line, 
and also in § 5.4.2 by using the theta polynomial for the characteristic root. 

• Theorem 5.19 —Let M. be a trace monoid, of Mobius polynomial p-M (§ 2.2.1), and 
let po G (0,1) be the root of smallest modulus of pM . 

Then the characteristic root to of the tip-top action x A1 —is given by 
to = ■ The Parry cocyle of the action is given by: 

V( 7 , 7 ') G X r( 7 , 7 ') = . (47) 
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Proof. Let v = {va)a^^ be the uniform measure of the tip-top action, and let 
be the associated Mobius valuation. 

Consider a clique 7 G Then 7 is also an action enabled at state 7 , the action 
of which yields to the empty clique 1. Given the result of Corollary 5.18, point 2, on 
the one hand, and the form (44) of the uniform measure, we have thus: 

fiii) = 1 = 4^'r(7,1), r(7,1) = to 1^1 . 

The cocyle relation yields r(l, 7 ) = r( 7 ,1)“^ = . Using again the cocyle 

relation, we obtain for any two cliques 7 , 7 ' G 

r(7,7') = r(7,i)r(i,7') = tl7''-''^', 


proving (47). 

We obtain also the following form for the restriction to ‘rf of 

V7G'^ /i(7) = t{7'r(l,7) = if'- 

Let hi{-) be the Mobius transform of /i(-)- Then by the Mobius condition for fi , 
we have /ii(l) =0 which is equivalent to = 0, hence tg is a root of fj,M ■ The 

Mobius conditions also impose ^ 11 ( 7 ) > 0 for all non empty cliques 7 G £. Lemma 5.20 
below shows that among the roots of fj,M , only the root of smallest modulus satisfies 
these conditions. This completes the proof. □ 

In the course of the above proof, we have used the following lemma. The key 
ingredient is the uniqueness of uniform measures shown in [4]. 

• Lemma 5.20 — Let Ai be a trace monoid, of Mobius polynomial ■ Let t be a 

non negative real, let f : Ai ^ R be the uniform valuation defined by f{x) = , 

and let h : ^ ^ M. be the Mobius transform of f\^ . Assume that h{l) = 0 and that 
h{c) > 0 for all non empty cliques c € €. Then t is the root of smallest modulus 

of p-M ■ 

Proof. Let D be the dependence relation of the monoid Ai = AI(E,/), defined by 
H = (S X E) \ J. The monoid Ai is said to be irreducible—not to be confused with 
the irreducibility of actions—if (E, D) is connected as an unoriented graph. 

The proof of the lemma is based on the following fact: there exists a unique 
Bernoulli measure n on dAi such that x) = t^^^ for all x G AI and for some real 
I > 0, and t is the root po of smallest modulus of ■ This is proved in Theorem 1.6 
of [4] if Ai is irreducible. But it is true also if Ai is not irreducible, by considering 
the projection of v to the component of AI, of which the smallest root of the Mobius 
polynomial coincides with po (see [18, Prop. 4.6] and [5, Prop. Ij). 

Now, given the real number t and the valuation / as in the statement of the lemma, 
we claim that there exists a Bernoulli measure v on dAi such that x) = /(x). 
Indeed, considering the unique total and trivial action of AI on the singleton {*}, 
then the valuation / can be seen as a fibred Mobius valuation with respect to this 
action. An application of Theorem 4.8 yields the existence of v. Hence t = po . □ 
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